Dynamics of EEG Entropy: beyond signal plus noise 
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EEG time series are analyzed using the diffusion entropy method. The resulting EEG entropy 
manifests short-time scaling, asymptotic saturation and an attenuated alpha-rhythm modulation. 
' These properties are faithfully modeled by a phenomenological Langevin equation interpreted within 

I a neural network context. Detrended fluctuation analysis of the EEG data is compared with diffusion 

, entropy analysis and is found to suppress certain important properties of the EEG time series. 

D 

I. INTRODUCTION 

, The mammalian brain generates a small but measurable electrical signal; first measured in small animals by Caton 
in 1875 and in people by Berger in 1925. The trace left on a strip chart by this amplified signal was called an 
electroencephalograph and the term electroencephalogram (EEG) has subsequently been used to identify the electrical 
signal. The power associated with the EEG signal is distributed over the frequency interval 0.5 to 100 Hz, with 
most of it concentrated in the interval 1 to 30 Hz. A typical EEG signal looks like a random time series with 
^ contributions from every part of the spectrum appearing with random phases. In the nearly one hundred years 
since the electroencephalogram (EEG) was introduced into neuroscience there have been a variety of methods used 
in attempts to establish a taxonomy of EEG patterns in order to delineate the correspondence between brain wave 
patterns and brain activity. The mathematician Norbert Wiener proposed generalized harmonic analysis [l[ as the 
O i' mathematical tool necessary to penetrate the mysterious relations between the EEG time series and the functioning 
of the brain. Subsequently, spectral methods have figured prominently in characterizing the properties of EEG time 
series. More recently nonlinear processing techniques, with their implicit dependence on nonlinear dynamics, chaos 
, and fractals have lead the parade of methodologies hoping to accomplish this task, see, for example. West i2j for 
• a brief review. The progress in relating EEG patterns to brain function has been slow and the understanding and 
interpretation of EEG signals remain elusive. However certain properties of EEG signals have revealed themselves 
over time. 

Over the past half century the single channel EEG time series has been interpreted as consisting of relatively slow 
. regular variations called signal, which is the integrated contribution of the neurons in the vicinity of the channel lead 
along with the 'coherent' influence of distant neurons, and the relatively rapid erratic fluctuations called noise, which 
0^ . is the 'incoherent' contribution of the distal neurons in the brain. However, the erratic behavior of the EEG time series 
' is so robust that it persists through all but the most drastic situations including near-lethal levels of anesthesia, several 
^ minutes of asphyxia and the complete surgical isolation of a slab of cortex Q . This separation implies that the signal 
contains information about the particular neurons associated with the EEG channels in the brain, whereas the erratic 
. , fluctuations are a property of a channel's environment and does not contain any useful information. Recent studies 
■ have refined this engineering model of signal plus noise and extracted information from the random fluctuations by 
concentrating on what is believed to be the scaling behavior of EEG time series. 

A number of research groups [1, H, 0, 0, Q have recently determined that EEG time series X{t) have scaling 
properties, with a second moment that increases as a non-trivial power-law, that is, (X(t)'^) oc i^^. Here the brackets 
denote a suitably deflned averaging over the data. In random walk models of classical diffusion the scaling exponent 
would be given by H = 0.5, whereas sub-diffusion processes would have H < 0.5 and super-diffusion processes would 
have H > 0.5. The index H was introduced by Mandelbrot into the study of the long-time memory of the statistical 
fluctuations of time series in recognition of Hurst who first observed such an effect in the yearly river flow of the Nile. 
The spectrum S{f) associated with such time series fall in the category of 1/f noise, that is, the Fourier transform 
of the autocorrelation function is given by >S'(/) oc 1/ with frequency / and power-law index related to the Hurst 
exponent by /3 = 2H — 1, consequently the if the index falls within the interval < /3 < 1 the underlying process 
is super-diffusive. However the spectral index can be greater than one for general complex phenomena such as EEG 
time series. In general however the spectral approach is not reliable because the EEG time series are non-stationary 
and consequently their direct Fourier transforms are ill-defined. 
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The 'signal' parts of the EEG time series are called waves or rhythms. The nature and scope of these waves have 
been widely investigated, see Ba§ar Q for a review. The alpha rhythm (7-12 Hz) has been shown to be typical of 
awake individuals when the brain is under no stimulation. Ba§ar et al.[l^ have developed an integrative theory of 
alpha oscillations in brain functioning. They hypothesize that there is not one, but several alpha-wave generators 
distributed within the brain and note that the alpha rhythm may act as a nonlinear clock in the manner suggested 
by Wiener [![ to serve as a gMing function to facilitate the association mechanisms within the brain. 

The method of choice [1,1^, [a H @|i used to address the issue of non-stationarity in EEG signals, is detrended 
fluctuation analysis (DFA) which provides a measure of the standard deviation of the detrended fluctuations [ll[. 
This method of processing EEG time series to determine scaling behavior consistently finds fractal properties, such 
as those observed in earlier studies. DFA has been used to quantify the scali ng p roperty of EEG dynamics by direct 
application to EEG signals 0, Q and to EEG increments Buiatti et al. [12| | use DFA to show that specific task 
demands can modify the temporal scale-free dynamics of the ongoing brain activity as measured by the scaling index. 
Watters and Martin Q recognized the two scaling regimes observed in the processing of EEG time series by a number 
of investigators and proposed zero-crossings as an alternative method of analysis in order to focus on the long-time 
correlations in the EEG signal. They dichotomize the EEG series according to the zero crossing time series and apply 
DFA to the dichotomized EEG. Stead et al. J,] apply DFA to the energy, that is to the square modulus, of an EEG 
signal. Finally, the authors of [HI analyzed the histograms for the DFA detrended EEG time series to estimate the 
associated probability density function (pdf) and its scaling properties. 

The observed scaling in EEG time series is not as straightforward as that observed in other less complex phenomena. 
Hwa for example, finds that the standard deviation of the EEG fluctuations exhibit two distinct scaling regions, 
whose variability was analyzed through a moment technique that could discriminate between normals and those that 
had undergone a stroke with up to 90% accuracy. Robinson [3] , on the other hand, in his analysis of EEG time series 
demonstrated the existence of scaling up to a point in time after which saturation in the standard deviation occurrs. 
He attributed this saturation effect to "dendritic filtering" and the DFA averaging the influence of the shape of the 
spectrum on the time series. Finally, DFA has been used to study eventual correlation of the alpha rhythm [l^ [l6l | 

Various measures other than the standard deviation, spectrum and the distribution of zero crossings have been 
introduced into the study of EEG time series, each one stressing a different physiologic property thought to be 
important in representing the brain's dynamics. One recent measure introduced to quantify the level of coherence in 
EEG signals is entropy. However, the entropy of Boltzmann and the information entropy of Shannon would not be 
immediately evident in many of these studies. For example, Inouye et al. JJj employed spectral entropy, as defined by 
the Fourier power spectrum, but the fact that EEG time series are not stationary, in the sense that the autocorrelation 
function is not simply a function of the two-time difference, obviates the use of Fourier transforms. Schlogl et al. [l^ 
measured the information entropy of 16 bit EEG polysomnograhic records and found it to be in the range of 8-11 
bits. Patel et al. [19j |. using a combination of fMRI and entropy maximization, where the probability density in the 
entropy definition is replaced with a scaled dipole strength, demonstrated that the generators of alpha rhythm are 
mainly concentrated over the posterior regions of the cortex, consistent with the theoretical speculations of others 
. Subsequently, wavelet entropy, in which the probability density is replaced with the relative wavelet energy, was 
used by Rosso et al. [13, HH to study the order/disorder dynamics in short duration EEG signals including evoked 
response potentials. 

In Section H we introduce stochastic differential equations as a way to model complex phenomena. The pdf 
determined by the stochastic equations are used to construct the diffusion entropy (DE), which is shown to be a 
viable measure of the dynamic mechanisms introduced into such stochastic models. DE analysis is also used to 
process EEG time series data and consequently suggests a form for the stochastic dynamical equations with which to 
model the observed EEG properties. Section III introduces the signal plus noise paradigm of signal processing, which 
is arguably the basis for DFA, recently the favored technique in the neuroscience literature for the analysis of EEG 
time series. The EEG models developed in Section II are shown to lead to much different conclusions regarding the 
scaling of EEG data depending on whether the DE or DFA methods are used for their analysis. The coherence of 
alpha wave is discussed in Section IV to explain why the alpha-wave modulation of the EEG entropy is attenuated 
over time. Finally, we draw some conclusions in Section V. 



II. EEG MODELS 

Most recently the authors \22] have used the DE method ^23j to characterize the EEG time series dynamic properties. 
This technique had been successfully used previously to discriminate between the contributions of low-frequency 
waves (signal) and high-frequency fluctuations (noise) in a number of other phenomena, for example, to determine the 
seasonal influence on the daily number of teen births in Texas [13] ; the effect of solar cycles on the statistics of solar 
flares [11] ; the influence of solar dynamics on the average global temperature anomalous fluctuations [1^ . Herein we 
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use the DE method to provide insight into the low/high frequency dynamics of EEG time series and compare those 
resuhs with processing of the same data using DFA. 

A. Ornstien-Uhlenbeck Langevin equation 

In the physics hterature there are two strategies for treating stochastic phenomena, those involving stochastic 
differential equations for the dynamic variables and those involving the partial differential equations of evolution for 
the probability density in phase space. The former are called collectively Langevin equations and the latter Fokker- 
Planck equations. Here we use a Langevin equation to model the EEG time series because it enables us to isolate 
the various physiologic mechanism that might contribute to the signal. For review consider the Ornstein-Uhlenbeck 
(OU) Langevin equation for a linearly dissipative stochastic process 

^-^^-xx{t)+at) (1) 

where the random force ^ {t) is delta correlated in time with strength D and has Gaussian statistics 

{at)at + r))=2D5{T), (2) 

where the symbol <...> indicates the ensemble average. Here there are two physical mechanisms; the heat bath 
modeling the environment giving rise to the random force and the dissipation modeling the average energy extracted 
from the dynamic system by the environment, see for example, Lindenberg and West [27|. In a physical system the 
fluctuations and dissipation are interdependent through the Einstein relation 

^ = fcT (3) 

in order for the system to be thermodynamically closed. Equation ([3]) is also known as the fluctuation-dissipation 
relation, which defines the equilibrium temperature of the heat bath in terms of the ratio of the strength of the 
fluctuations to the dissipation rate. 
The variance of the dynamic process 

a^t)^{X^t))-{X{t)f (4) 
is given here, using the solution to the OU Langevin equation, 

t t 



= f [1 - e-''^] . (5) 



Consequently, for 1/A the variance increases linearly with time 



limcr^ (t) « 2Dt (6) 



so that the scaling index is H=0.5. For 1/A the variance becomes time independent 



\ima^{t) = -, (7) 

t — ^oo A 

with a saturation induced by the dissipation. In the engineering literature the dissipation is called a filter and its 
influence on the time series is a negative feedback reducing the difference between the observed and desired signal. It 
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is this uncontrolled difference, the noise, that is observed in the asymptotic saturation level given by the ratio of the 
strength of the fluctuations and the dissipation rate. 

The solution to the Langevin equation defines a trajectory. An ensemble of such trajectories, generated by the 
random force, is used to construct the histogram of the number of trajectories falling in a specified interval to 
estimate the pdf p(x,t). The pdf can then be used to calculated the information entropy, a quantity introduced in 
discrete form for coding information by Shannon psl ] and in continuous form for studying the problem of noise and 
messages in electrical filters by Wiener [29|]. We use the latter form here, 

S{t)=- J p{x,t)log^p{x,t)dx. (8) 

Given the Gaussian statistics of the random force in the OU Langevin equation we know that the statistics of the 
dynamical variable are also Gaussian. Substituting a Gaussian distribution with a variance cr^ (t) into ([5]) we obtain 

Sit) = log2 (V2^(T(i)) . (9) 

Consequently, for t-^ 1/A using the approximate variance of Eq. ^ the entropy increases as 

\hnS{t) = i log2 {AnDe) + ^ log, t (10) 

and a linear- log plot yields a straight line of slope H—Q.5. At the other extreme t'^ 1/A using the approximate 
variance (O the entropy reaches the saturation level 

This use of information entropy is suggestive in that it shares certain properties with the EEG analysis discussed in 
the Introduction that being scaling behavior at early times followed by asymptotic saturation. We exploit these two 
mathematical properties of the OU Langenvin equation in the Section IIC to develop a dynamical model of EEG time 
series. 



B. EEG data analysis 



Each single channel recording of the EEG time series consists of a sequence of + 1 data points, and the difference 
between successive data points is denoted by for j — 1,2, .., A^. For the DE analysis of the EEG data a set of 
diffusive variables Xk (t) is constructed from the differenced data points in the following way 

k+t 

^ = l>2,..,7V-t + l (12) 

j=k 

to obtain AI — N + 1 replicas of a diffusive trajectory using overlapping windows of length t. An ensemble of such 
trajectories, generated by the EEG time series, is used to construct the histogram from the number of trajectories 
falling in a specified interval to estimate the pdf. Note that this is analogous to what we did in the previous section, the 
procedural difference is that here we use data to define the trajectory and not the solution to a Langevin equation. 
Another difference is that we do not know the form of the pdf that results from the histogram. However we can 
anticipate a class of pd/'s based on previous investigations. For example Schlogi et al. 18] observed a deviation from 
Gaussian behavior with a time-dependent variance, but with nearly symmetric empirical distribution functions. We 
assume here, but latter establish a theoretical model, a simple analytical form for the pdf of the diffusion process that 
satisfies the scaling relation: 

Note that a Gaussian diffusion process satisfies with a time-dependent standard deviation a{t). More generally 
an alpha-stable Levy process also scales in this way, in which case a{t) is more general than the standard deviation 
of the underlying process. The scaling condition so often anticiapted in EEG time series implies that 



a{t) = kt\ 



(14) 
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where fc is a constant. Substituting Eqs. (fT3|) and (|14p into Eq. ^ yields 



S{t) = - / F{y) log2 F{y)dy + log^ k + 5\oi 



'g2t = C + 5l0g2t. 



(15) 



This diffusion entropy graphed versus time on log-Hnear graph paper would increase linearly with slope 5 with an 
initial level determined by the constant C. Consequently, the way in which the entropy for a time series scales is 
indicative of the scaling behavior of the underlying time series and consequently of the pdf. Note that in a simple 
diffusive process this scaling index is equal to the one obtained from calculating the second moments, that is, S=H . 
However, in general, even when the data do scale the two power-law indices are not necessarily equal and S^H . 

We now consider EEG signals of twenty awake individuals in the absence of external stimulations (quiet, closed eyes). 
EEG signals were recorded using the 10-20 international recording scheme. For eight individuals only the channels 
01,02,C3 and C4 were recorded, for the remaining twelve all the channels are available. To have a consistent database, 
we restrict our analysis to the channels 01,02,C3 and C4, which are the channels traditionally used in sleep studies. 
The sampling frequency of all EEG records is 250Hz, and durations of EEG records vary from 55s to 400s with an 
average duration of 128.1s. 

Fig. [T] shows the DE of the EEG increments for the somnographic channels 01,02,C3 and C4 of a single individual. 
We see how for each channel the EEG diffusion entropy: 1) reaches a saturation level, 2) has an "alpha" (~7.6 HZ in 
the case of this individual) modulation which is attenuated with time, and 3) has a small amplitude residual asymptotic 
modulation. The early-time modulation, with variable frequency in the alpha range and variable amplitude, is observed 
in the somnographic channels for all subjects. The saturation effect is present in all channels for all subjects and it 
should be pointed out that this saturation is neither a consequence of the finite length of the time series, nor of the 
finite amplitude of the EEG signal. In fact when we randomly rearranged the data points, thereby destroying any 
long time correlation in the time series, the EEG entropy no longer saturates. Consequently, this saturation effect is 
due to correlated brain dynamics and is not an artifact of the data processing. The inset in Fig. [1] depicts the pdfs 
Psntix), after the entropy saturation is attained. These distributions have approximately exponential tails. Fig. [2] 
depicts the diffusion entropy for the nineteen channels of a representative individual. In this figure the somnographic 
channels have strong alpha rhythms, but the other channels do not. However it is evident that regardless of the alpha 
wave content of the EEG time series each and every channel saturates. 



The simplest dynamic model, which includes all the properties identified in Fig. [l] these being, fluctuations, modu- 
lation and dissipation, has the form of a Langevin equation. We assume a dissipative linear dynamic process dynamic 
process X{t), i.e., an OU process, with a periodic driver having a random amplitude and frequency and an additive 
random force rj (t) which is a delta correlated Gaussian process of strength D: 



The coefficient A is positive definite and defines a negative feedback, x [Ij.s] — 1 when the argument of x [] is the time 
interval Ij ^ — [jtg, {j + l)is] and is zero otherwise, and tg is the 'stability' time after which a new constant frequency 
fj and a new constant amplitude Aj are selected. 

The values of the frequencies fj and amplitudes Aj are empirical and determined in the following way. First, we 
evaluate the spectral density in the time-frequency domain of time series of EEG increments with a time resolution 
ts and a frequency resolution A/ by means of a Windowed Fourier Transform. The theoretical spectral density is 
estimated from the spectrogram, which is the spectrum of a time series for a given time resolution, but which changes 
as a function of time. Therefore there is no one spectrum to characterize the process as we sweep through the non- 
stationary EEG time series, see the discussion on spectrograms in Ref. [13] ■ The spectral density, or spectrogram, 
is a three-dimensional plot of the spectrum of the EEG increments as it changes over time. Then, for each time 
interval of duration tg we consider the range of frequencies of the alpha waves, 7-12 Hz, and find which frequency has 
the maximum amplitude in the spectrogram. This procedure defines the frequency and the amplitude of the time 
interval considered. 

Panel (a) of Fig. [3] shows the spectrogram relative to the increments ^j of the channel 01 for the same subject as 
in Fig. [TJ Panels (b) and (c) of Fig. [3] show respectively the sequence of amplitudes Aj (normalized to a maximum 
amplitude of 1) and of frequencies fj calculated using the procedure described above. Without an a priori knowledge 
of the typical duration of an alpha wave packet, we set the stability time tg of Eq. equal to 0.5s. A time resolution 



C. EEG Langevin equation 




(16) 
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FIG. 1: The diffusion entropy S{t) calculated using the increments of the channels 01, 02, C3 and C4 for one of the 
20 subjects considered in this study. The inset depicts the asymptotic pdfs Pg^^.{x)—p{x,t = 2000) for each channel: 
squares (01), circles (02), upward triangles (C3), and downward triangles (C4). 

of 0.5s and a frequency resolution of approximately 0.5Hz in the spectrogram represent a reasonable time-frequency 
localization for our purposes. 

When the modulation is present Eq. (jl6p is numerically integrated, and the increments of the dynamic variable X 
are processed using the DE algorithm. In Fig. 21 we compare the EEG entropy obtained using the integrated solutions 
of Eq. with that of the channels 01 and C3, already shown in Fig.[TJ It is evident that the entropy constructed 
from the solution to Eq. captures the qualitative and many of the quantitative features of the DE of the EEG 
increments. Moreover, the asymptotic pdfs recorded in the inset also agree with the empirical pdfs depicted in Fig. [T] 
In Table 1 we average the phenomenological parameters A and D for the somnographic channels for the twenty subjects 
in this study. Note that both the strength of the fluctuations and the dissipation rates change between the 01, 02 

TABLE I: The average values (avg.) and the standard deviations (s.d.) of the parameters A and D of Eq. pB]) for 

all 20 subjects in this study. 



EEG channel 


A (avg.zbs.d.) 


D (avg.zbs.d.) 


Ol 


0.0461±0.0187 


16.37±6.88 


02 


0.0497±0.0182 


16.35±6.72 


C3 


0.0362±0.0186 


10.19±3.90 


C4 


0.0393±0.0200 


10.60±3.72 



values and the C3, C4 values. This suggests that the channel environment changes in a statisitically significant way 



0.01 



0.1 



1 



10 



t (seconds) 



FIG. 2: The diffusion entropy S{t) of the EEG increments of all the 19 channels for one of the 20 subjects 

considered in this study. 



from one region of the brain to another, with the 01, 02 channels being noisier and more dissipative. 



In Sec. |TT1 we showed how the properties of the EEG records can be modeled using an OU Langevin equation: 
The solution to Eq. (|16p if the EEG record has an alpha rhythm (the generalization to a different rhythm or a sum 
of two or more rhythms is straightforward), and the solution to Eq. ^ if no rhythm is present. As stated in the 
Introduction, a main tenet of the traditional EEG analysis is the decomposition of an EEG record Xj into the sum 
of two orthogonal components: 



where Sj is the time varying mean or signal (rhythms), Nj is the noise or random component and Cov(S', A^) is the 
covariance of the two. DFA was introduced [11| as a tool to measure the scaling of the variance of the noise component 
of a time series Nj without a priori knowledge of the signal component of the time series Sj. For this reason, as well 
as the fact that it apparently works for time series that scale, DFA has been widely used in the analysis of EEG time 
series. 

However, the signal plus noise decomposition of Eq. ([T7]) is not applicable to the OU processes or the driven OU 
processes of Eqs. ([ij and (fT6|) . respectively. The solution to Eq. ^ is 



III. DIFFUSION ENTROPY ANALYSIS VERSUS DFA 



Xj = + Nj and Cov(S', N)=0 



(17) 




(18) 
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FIG. 3: (a) Spectrogram of the increments of channel 01. We plot the base-10 logarithm of the spectral density. 
The time resolution is ts=0.5 s, the frequency resolution is A/=0.5 Hz. (b) Sequence of the maxima of the 
spectrogram amplitude (normalized so that the maximum amplitude is 1). This sequence of coefficients Aj is used in 
Eq. ( I16p . (c) Sequence of the frequencies corresponding to the amplitude maxima of the spectrogram. This 

sequence of coefficient fj is used in Eq. ((1 



where we assumed, without loss of generality, that X{0)=0. In this case we have no signal component. Moreover, 
Eq. ([TH]) states that the present value of X{t) depends on all the previous history. In particular, the autocorrelation 
function of the increments £,{t)=d/dtX{t) is negative with an exponential decay: 



cr^{t) = S{t) - 4DAexp(-2Af) , 



(19) 



where 5{t) is the Dirac delta function. A consequence of Eq. (I19[) is that the power spectrum of the increment time 
series £,{t) does not satisfy the relation S{f) cc Applying the Wiener— Khintchine theorem to Eq. (fT9|) . we 

obtain 



Sif) - 1 



1 - 



4A2 



4A2 + An^p 



(20) 



and consequently the spectrum is zero at low frequencies and increases quadratically to a constant value at high 
frequencies. But let us consider the more general case, using the solution of Eq. (fTH]) . assuming X(0)=0, 



X{t) 



3=0 



Ajx [Ij.s] sin (27r/,t') 



.At' 



dt'. 



(21) 



If we identify the alpha- wave component, the second term under the integral, as the signal then it is not possible to 
separate X{t) according to Eq. ([TT]). In particular the covariance Cov(5', TV) does not vanish because the present value 
of X{t) depends on its previous values. As for the covariance function of the increments in this case, the behavior of 
Eq. (I19p is periodically modulated, while the power spectrum shows a peak in the alpha range as shown in Fig. O 

For these reasons, in this section, we compare the results of DFA and DE when applied to EEG records, and to 
records (via numerical integration) of the OU processes of Eqs. H]) and We set the lenght of these records to 

be 50,000 to match the typical length of the EEG records examined herein: 50,000 data points is equivalent to 200 
seconds of data with a 250IIz sampling frequency. 
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FIG. 4: Comparison between the diffusion entropy of the increments, sohd hnes, of channel 01 and C3, and 
diffusion entropy of the increments, points, of the variable X of Eq. The parameters used in Eq. are 

A=0.055 D=40 for 01 and A=0.055 D=20 for C3. Inset show the comparison between the asymptotic pdfs 
p^^^.{X)=p{X,t — 2000): channels 01 and C3, solid lines, variable X of Eq. squares. 



First, we briefly describe the DFA algorithm. Given a time series Xk, the zero-averaged time series is aggregated 



k=j 

E 

fc=i 



[Xk — Xavg] 



(22) 



where Xavg is the average of the time series Xk- The integrated signal is divided into windows of size t. Here we 
use overlapping windows adop ting the same procedure as the DE algorithm fSec. IIIBj) . while the original algorithm 
uses non-overlapping windows [ll|. For each window, a least-squares fit is computed with a polynomial of order n>l. 
This fitting procedure eliminates the local trend: the signal in that porticular window. Finally the local trend is 
subtracted from the integrated time series and the standard deviation of the residuals Yj calculated: 



1 ' 



(23) 



These steps are repeated for increasing values of the window size t. The scaling condition for the standard deviation 
implies 



F{t) cx ^ log2 F{t) cx a log^ t 
where the scaling parameter is in the interval < a < 1. 



(24) 
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FIG. 5: The solide line depicts the power spectrum of the increnients of the variable X{t) of Eq. (|18p (A=0.055 and 
15=800), the dashed hne depicts the power spectrum of the increments of the variable X{t) of Eq. (pijl (A=0.055, 
-D=800 and alpha wave coefficients of the channel 01 of Fig H]). 



In Fig. [HI we plot the results of DE and DFA when applied to the time series of the increments of the variable 
X{t) of Eq. H]) with A=0.055 and 15=800. The DE (triangles) agrees [IH with the theoretical prediction of Eq. ^ 
(solid line). Moreover, the DE results show that the approximation given by Eq. (fTU]) for the case A=0.055 is valid 
up ~0. 02— 0.03s (note that the factor 1/A must be divided by the value of sampling frequency which is 250IIz). DFA 
results (circles for a linear detrending and squares for a quadratic detrending) show hints of a saturation regime more 
than two decades later than it actually occurs: ~ 10s instead of ~ 0.1s. As for the expected initial regime F{t) (Xy/i 
(Eq. one can linearly fit the DFA curves in different ranges for times t < 0.4s (before the strong "bending" occurs 
in the DFA). The results depend on the particular fitting range used: e.g. in the range 0.04s < t < OAs the resulting 
slope (for the DFA curve obtained with a linear detrending) is ~ 0.44. 

Fig. [7] shows the results of the DE method and DFA for the increments of a EEG record (channel 01) and the 
increments of its best approximation via the model of Eq. fSection III Cp . We notice how the results, for both 
DE ad DFA, relative to the OU process of Eq. (fTB|) (triangles for DE and circles and squares for DFA) reproduce 
those relative to the EEG record (solid line). We notice how the presence of the alpha rhythm results in an initial 
(t < 0.04s) slope of the diffusion entropy S{t) which is larger than 0.5 as expected with no alpha rhythm Eq. (fTO]) '): 
for times smaller than the typical period of the alpha rhythm, the alpha rhythm is "equivalent" to a trend which 
produce an additional entropy increase (for detailed discussion of this effect see [l^], for example. As for the results 
of DFA, we see how the modulation due to the alpha-wave packets has been eliminated and instead two "slopes" are 
observed for t < 0.2s. As in Fig. DFA approaches a saturation regime two decades later than what expected from 
the model of Eq. (|16p and correctly detected by the DE. For the DFA curve obtained with a quadratic detrending, we 
have: slope 0.65 for 0.01s <t< 0.06s, slope 1.2 for 0.08s <t< 0.2s, and slope 0.1 for 0.3s <t< 1.6s. These results 
indicate that the DFA is not able to accurately "detrend" the periodic component (alpha wave) and the observed 
linear regimes are not actual scaling regimes. In Figs. [5] and [3 we have applied the DE and the DFA to the increments 
of the variable X{t) (Eq. ^ for Fig. [5] and Eq. for Fig. [7]) or to the EEG increments Some investigators 
Q use DFA to analyze the resting (closed eye) EEG of normal subjects and of subjects with acute ischemic stroke. 
They report the presence in virtually all channel and for all subjects of a "double" scaling regime in the time ranges 
corresponding to the second and third linear regimes of Fig. M The reported 3 ranges of values for the scaling 
parameters are compatible with the one calculated for Fig. [SI However the analysis presented in this manuscript 
suggest that these linear regimes observed in the DFA are not genuine scaling regimes but are the result of the EEG 
dynamics not satisfying the signal plus noise decomposition of Eq. (|17p thereby compromising the capability of the 
DFA to detrend the alpha- wave component. 
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FIG. 6: DE and DFA for the increments of the variable X{t) of Eq. (P) with A=0.055 and £1=800. The triangles 
indicates the values of the entropy S'(t), while circles (linear detrending) and squares (quadratic detrending) are the 
values of base-2 logarithm of the variance F[t). The solid lines are the expected values for S(t) and log2(F(i)). The 

dashed line indicates a logarithmic increase with a slope 0.5. 



Most studies in the literature, however, report results of the application of DFA to the EEG time series itself. Thus, 
we too apply DE and DFA to the variable X(t) of Eqs. ([T]) and (fTH]) . and to the EEG itself as well. 

Fig. [5] show the application of DE and DFA to the variable X(t) satisfying Eq. ([T]). The solid lines represent the 
expected values for the standard deviation. These are obtained by integrating the variable X(t) 

t t t' 

Y{t) = j X{t')dt' = J dt'e-^'' J r/(/')e^*" (25) 





and calculating the variance (Ty(i) 

A3 



a^{t)^^[2Xt + Ae-^*-e-^^'-3]. (26) 



Using Eq. ([SH]). we obtain for times t^l/X 



while for t>l/A 



lim4(t) = ^Dt\ (27) 



9 . ^ 2L> 3D 
}}^yyit)-^t--. (28) 
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FIG. 7: DE method and DFA for the increments of a EEG record (channel 01) and the increments of its best 
approximation via the model of Eq. fSection IIICp . Solid lines indicate the results of DE and DFA relative to 
the EEG record. Trianlges indicate the results of DE calculation relative to the Ornstein-Uhlenbeck process of 
Eq. (jl6p approximating the EEG record, while circles (linear detrending) and squares (quadratic deternding) 
indicate those of DFA. Finally, the dashed line indicates a logaritmic increase with a slope of 0.5. 



Finally, since Y(t) is a Gaussian variable for all time t we can obtain the value of the diffusion entropy S{t) using 
Eq. We see from Fig. [7] that the numerical diffusion entropy (triangles) departs from the theoretical expectations 
at early times (t^l/A). In fact the initial slope of the numerical diffusion entropy is ~1 (0.96 for t < 0.04s) instead of 
1.5 as expected from Eq. ([27]) . This is due to the overlapping window procedure used by DE [sij. For times t » 1/A 
the numerical diffusion entropy reproduces the expected results (slope 0.51 for 0.4s < t < Is): the discrepancy for 
times t > 3s is due to the finiteness of the record used. 

The DFA curves seems to reproduce both the early time scaling and the later time scaling: the initial slope is 1.4 
(0.01s < t < 0.1s), while for 2s<t<10s the DFA curves have slope 0.52. The major discrepancy between the numerical 
DFA curves and the expected behavior for log2F{t) (aside from the shift in values) is that the scaling regime with 
parameter ~0.5 is delayed one decade in time (~ 2s instead of ~ 0.4s). This effect also occurred for in the case of the 
increments of the variable X{t) of Eq. ^ (Fig. [4]). Fig. [9] shows the results of the DE method and DFA for a EEG 
record (channel 01) and its best approximation via the model of Eq. (|16p (Section III G|) . Since the DE algorithm does 
not have any detrending procedure the presence of an alpha rhythm produces modulation observed for t Is both 
for the real EEG (solid line) and the its approximation (squares). The DE of the EEG and that of the model depart 
at ~0.8 — Is: the EEG entropy saturates while the model DE continues to increase. The DFA of the real EEG shows 
a double "scaling" regime for the DFA {t <0.1s and 0.4s<t <4s). At t^As a split, similar to that observed in the DE 
at i^ls, occurs between the DFA of the EEG which saturates and that of the model which continues to increase. The 
slope (we report the values for the DFA with linear detrending as the values for the quadratic detrending are similar) 
of the first scaling regime is 1.75 for the EEG record and 1.73 for the model approximation. The second scaling regime 
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FIG. 8: DE and DFA for the variable X{t) of Eq. (P) with A=0.055 and L»=800. The triangles indicates the values 
of the entropy S(t), while circles (linear detrending) and squares (quadratic detrending) are the values of base-2 
logarithm of the variance F{t). The solid lines are the expected values for S{t) and log2{F{t)). The dashed line 

indicates a logarithmic increase with a slope 0.5. 



has a slope of 0.65 for the EEG and 0.64 for the model approximation. Are these genuine scaling regimes? As in the 
similar case presented in Fig. [21 these linear regime are not genuine scaling regimes but are the result of the EEG 
dynamics not satisfying the decomposition of Eq. ([TT]) which compromises the capability of the DFA to detrend the 
alpha-wave component. For times i>4s the DFA curve relative to the EEG starts to bend so that a linear fit is not 
feasible. However the model approximation curves keep increasing. The nature of the saturation observed for both 
DE and DFA in Fig. [9] has been recently explained [32| as being due to high-pass filtering by the EEG recording 
apparatus. Valencia et al. 132*1 show that the saturation time for the DFA of the EEG record is simply the inverse of 
the cutoff frequency /c of the high-pass filter: 0.3Hz in the present case. 

IV. COHERENCE OF ALPHA WAVE 

Nikulin and Brismar [T6j use the Hilbert transform of EEG time series to define a sequence of EEG amplitudes, 
which is then filtered to obtain a sequence of alpha rhythm amplitudes. DFA is then applied to this latter sequence 
to find scaling in the 5 — 50s range. The scaling parameters change within each channel of a single subject and 
among subjects: 0.71 median with a quartile range 0.63 — 0.81. Linkenkaer-Hansen et al. apply the DFA to 
the sequence of the moduli of the wavelet transform of the EEG signal in the scale range corresponding to the alpha 
rhythm (8.3 — 11.7Hz). They report a scaling parameter of 0.68 ± 0.07 (average over the subjects and channels) in 
the 5 — 300s time range. In Fig. (TU] we report the autocorrelation function for the times series of the amplitudes Aj 
and frequency fj for the alpha rhythm for two different channels: 01 and C3. Each couple {Ajjj} represents the 



14 




0.01 0.1 1 10 100 

t (seconds) 

FIG. 9: DE method and DFA for a EEG record (channel 01) and its best approximation via the model of Eq. (|16p 
(Section III C[) . Solid lines indicate the results of DE and DFA relative to the EEG record. Trianlges indicate the 
results of DE calculation relative to the Ornstein-Uhlenbeck process of Eq. ([16]) approximating the EEG record, 

while circles (linear detrending) and squares (quadratic deternding) indicate those of DFA. Finally, the dashed line 

indicates a logaritmic increase with a slope of 0.5. 



amplitude and frequency of the alpha rhythm during 0.5s of EEG activity (see Section IIC). Fig. [TUl shows fast decay 
for the autocorrelation of both the amplitudes and the frequencies of each channel. The autocorrelation drops to 
^ 0.1 — 0.2 at a lag of ~ 10 (which correspond to a coherence time of ^lOs) after which the autocorrelation function 
oscillates in the range (—0.2,0.2). To quantify the strength of the correlation between the sequences Aj and fj we 
shuffle the two time series and use Eq. ([T6l) to create a surrogate record. In Fig. [11] we compare the DE for the EEG 
increments (channel 01), with its best approximation via Eq. ()16|) and the surrogate data obtained applying Eq. (|16p 
to a shuffled sequence of couples {Aj,fj}. We see how shuffling the couples {Aj,fj} results in a sharper attenuation 
of the periodic alpha modulation, but does not change the qualitative results. 



V. DISCUSSION AND CONCLUSIONS 



The first notable property of the OU Langevin model of EEG time series is that the resulting EEG diffusive entropy 
reaches a saturation level. The EEG entropy saturation indicates that the EEG time series asymptotically carries 
a maximum amount of information. Robinson observed this saturation in the calculation of second moments of 
EEG time series and interpreted it as being due to dendritic filtering. The EEG entropy does not grow indefinitely 
as would a random process with long-time correlation; consequently, the EEG time series do not simply scale as had 
been previously assumed by a number of investigators [1, H, [1] . 

Schlogl et al. [3| remarked that biosignals typically saturate due to the limited dynamic range of amplifiers and 
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FIG. 10: Autocorrelation function for the sequence of amplitudes and frequencies of the alpha rhythm for the 
channels 01 and C4: empty sqaures (circles) indicate the autocorrelation function of the sequence Aj, and solid 
(dashed) lines the autocorrelation function of the sequence fj for the channel 01 (C4). 



observed the saturation of EEG entropy during sleep using data from eight European laboratories. However we find 
that the time constant for saturation due to the limited dynamic range of the amplifier is significantly larger than 
that due to physiologic processes in the brain as indicated by the lack of saturation in Fig. 8. How does this filtering 
procedure affects the observed results for the DE and DFA of the EEG increments (Fig. [H])? Is the saturation effect 
observed for the DE of the EEG increments genuine or is it an artefact of high pass filtering? Table I reports the 
typical values observed for the dissipation parameter A of the Eq. (|16p used to fit the observed DE curve relative to 
EEG increments. The time 1/A is the "saturation" time of the DE curve as shown by Eq. ([5]). The time 1/A can 
be considered as the "saturation" time even when an alpha-wave component in present in the EEG record, since this 
results in a periodic modulation to Eq. ([5]). Recalling that our EEG records are sampled at 250 Hz, and that from 
table I the value O.OAHz can be considered as a typical value for the parameter A, we obtain a typical saturation time 
of the order of 0.1s which is considerably smaller than the saturation time 1/ {0.3Hz) ~ 3.3s due to the high-pass 
filtering. 

The second notable property of the OU Langevin model is related to the first and is the dissipation, or negative 
feedback, produced locally within the channel of interest. The fluctuation-dissipation relation of Einstein quantifies 
the maximum level of the entropy in a closed physical network, and is given by the ratio of the strength of the additive 
fluctuations to the dissipation rate. In the more general OU driven Langevin equation given here we do not expect 
the saturation level to be given by this ratio alone, but to depend on the asymptotic value of the 'variance' a (t ^ oo). 
Note that the asymptotic 'variance' may not be independent of time, but contains residual information in the form 
of low amplitude beats because of its dependence on the random near-periodic driver. This mechanism also explains 
the saturation observed earlier [lij by associating the negative feedback with the dendritic flltering of the signal. 

The third notable feature of the OU Langevin model is the attenuated oscillation of the entropy in time. We 
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FIG. 11: Comparison of DE applied to the increments time series: solid line (EEG channel 01), dashed line (best 
approximation via Eq. (|16p and, dot-dashed line (surrogated data obtained applying Eq. (|16p to a shuffled sequence 

of couples {Ajjj}). 



reasonably interpret the attenuation of the modulation of the EEG entropy to be a consequence of the alpha rhythm 
not being generated at a single source, but to be a collective property of the brain being generated at a number of 
different locations [l^, [I^- Here the influence of the distributed sources is modeled by wave packets that persist 
for a stability time tg] one packet is replaced by another with a slightly different carrier frequency and amplitude 
chosen from the empirical spectrogram over time intervals of length ts- The concatenation of these wave packets 
with fluctuating frequencies and amplitudes produces a decoherence that attenuates the modulation of the resulting 
EEG entropy in time. Both Figures 10 and 11 indicate that the attenuation of the alpha rhythm is dependent on the 
statistics of the amplitude and frequency fluctuations and not on their statistics. 

The presence of alpha- rhythm modulation masks [2^ any early-time scaling property of the EEG dynamics. Eq. (jl6p 
is the simplest form of a fluctuation-dissipation process that implies the presence of internal feedback to prevent the 
occurrence of large excursions of the electric potential inside the brain. The presence of this negative feedback 
mechanism casts doubt on the possibility of understanding EEG records in terms of a sum of two independent 
components, noise and trend (signal), which is the usual assumption made for the DFA method. 

Finally, the analysis presented herein supports the notion that alpha rhythms are not passive states, but contain 
useful information within the frequency modulation. 

The authors thank the Army Research Offlce for support of this research. The code of the programs used for the EEG 
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